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Abstract 


Let F{z) be a vector-valued function, F : C — ► C N f which is analytic at z = 0 and mero- 
morphic in a neighbourhood of z = 0, and let its Maclaurin series be given. In this work we 
develop vector-valued rational approximation procedures for F(z) by applying vector 
extrapolation methods to the sequence of partial sums of its Maclaurin series. We analyze 
some of the algebraic and analytic properties of the rational approximations thus obtained, 
and show that they are akin to Pade approximants. In particular, we prove a Koenig type 
theorem concerning their poles and a de Montessus type thorem concerning their uniform 
convergence. We show how optimal approximations to multiple poles and to Laurent 
expansions about these poles can be constructed. Extensions of the procedures above and the 
accompanying theoretical results to functions defined in arbitrary linear spaces is also 
considered. One of the most interesting and immediate applications of the results of this 
work is to the matrix eigenvalue problem. In a forthcoming paper we exploit the 
developments of the present work to devise bona fide generalizations of the classical power 
method that are especially suitable for very large and sparse matrices. These generalizations 
can be used to approximate simultaneously several of the largest distinct eigenvalues and 
corresponding eigenvectors and invariant subspaces of arbitrary matrices which may or may 
not be diagonalizable, and are very closely related with known Krylov subspace methods. 
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1 Introduction 


Let F(z) be a vector-valued function, F : C — *• C^, which is analytic at z = 0 and mero- 
morphic in a neighbourhood of z — 0, and let its Maclaurin series be given as 

OO 

F(z) = £ (1.1) 

m=0 


where u m are fixed vectors in C . 


In this work we propose three types of vector- valued rational approximation procedures that are 
entirely based on the expansion in (1.1) . For each of these procedures the rational approximations 
have two indices, n and k, attached to them, and thus form a two-dimensional table akin to the 
Pade table or the Walsh array. Let us denote the (n, k) entry of this table by F ni k{z). Then F n> k{z), 
if it exists, is defined to be of the form 


FnM = 




X3L»«: 


(»»,*) y k-i 


Qn,k( Z ) 


with 4"' ] = Q„,fc(0) = 1, 


( 1 . 2 ) 


where v is an arbitrary but otherwise fixed integer > — 1, and 


F m {z) = m — 0,1,2,...; 

t '=0 


F m (z) = 0 for m < 0, 


(1.3) 


and the c( n,fc ^ 


are scalars that depend on the approximation procedure being used. 


If we denote the three approximation procedures by SMPE, SMMPE, and STEA, then the 
c ( n,fc ) = Cj ) for each of the three procedures, satisfy a linear system of equations of the form 


Jfc-i 

tijj Cj — Wtit, 0 ^ i ^ li 1, c/c 1, (1*1) 

j = 0 

where u,j are scalars defined as 


Uij = < 


( u n+t i u n+j ) 
(?<+ 1 > U n + j ) 
(<t, W n +i+j) 


for SMPE, 
for SMMPE, 
for STEA. 


(1.5) 


Here (• , •) is an inner product - not necessarily the standard Euclidean inner product - whose 
homogeneity property is such that (ax,/3y) = a(3(x,y ) for x,y € C N and a, (3 € C. The vectors 
9 i) 92 ?•••> form a linearly independent set, and the vector q is nonzero. Obviously, F n< k(z) exists if 
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the linear system in (1.4) has a solution for co,ci,...,Cjt_i. 


It is easy to verify that for SMPE the equations in (1.4) involving Co, Ci, are the normal 

equations for the least squares problem 


min 

Co, Cl 


k - 1 

iin-fj “I" 'U'n+k > 
j=0 


where the norm || • || is that induced by the inner product (• , 


•), namely, ||x|| = v/(x,x). 


( 1 . 6 ) 


As can be seen from (1.4) and (1.5), the denominator polynomial Q n ,k{ z ) Is constructed from 
u n ,u„+i,..., u n +k for SMPE and SMMPE, and from u n , u n+ i, ..., u n+2 fc-i for STEA. Once the 
denominators have been determined, the numerators involve Uq } U \ , ..., for all three approx- 

imation procedures. 


The approximation procedures above are very closely related to some vector extrapolation meth- 
ods. In fact, as is stated in Theorem 2.3 in Section 2, F n}k (z ) for SMPE, SMMPE, and STEA are 
obtained by applying some generalized versions of the minimal polynomial extrapolation (MPE), 
the modified minimal polynomial extrapolation (MMPE), and the topological epsilon algorithm 
(TEA), respectively, to the vector sequence F m (z),m = 0,1,2,... . For early references pertaining 
to these methods and their description and convergence properties, see the survey paper of Smith, 
Ford and Sidi [SmFSi], and for recent developments see the papers by Sidi [Sil] and [Si2], Sidi 
and Bridger [SiB], Sidi, Ford, and Smith [SiFSm], and Ford and Sidi [FSi]. The above mentioned 
generalizations of vector extrapolation methods are given in [SiB, eqs.(1.16) and (1.17).]. 

In Theorems 2.1 and 2.2 in Section 2 we show that the approximations F n , k {z) enjoy some 
Pad4-like properties. 

In Section 3 we give some simple technical results concerning the structure of the u m and 
F m (z),m = 0,1,2,..., when the function F(z) is meromorphic in a disk, and we also introduce 
some conditions on F(z) and on the procedures SMPE, SMMPE, and STEA, which seem to be 
necessary in order to obtain the main results of Section 4. 
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One of the main aims of this work is to present a detailed analysis of the approximations 
F n ,k( z ) that have been defined above, for n — > oo. We start by proving a Koenig type theorem for 
the denominator polynomials Qn t k ( z )• Particular, we analyze the convergence behavior of these 
polynomials, and prove that their zeros tend to the k smallest poles of F(z ) under certain condi- 
tions, providing at the same time precise rates of convergence for them. All this is done in Theorem 
4.1 and Theorem 4.5. We next analyze the convergence of the F ni k(z) in the complex 2 -plane and 
prove a de Montessus type theorem on their uniform convergence. This is done in Theorem 4.2. 
Other useful results pertaining to the F n ^(z) and their poles and corresponding residues are given 
in Theorems 4.3 and 4.4 and in Section 5. 

It turns out that the denominator polynomials Qn t k{ z ) are ve3 T close ty related to some recent 
extensions of the power method for the matrix eigenvalue problem, see [SiB, Section 6] and [Si3]. 
Specifically, if the vectors u m of (1.1) are obtained from u m = = 1,2,..., with u 0 arbi- 

trary, and A being a complex N xN and, in general, nondiagonalizable matrix, then the reciprocals 
of the zeros of the polynomial Q n> k{ z ) are approximations to the largest distinct and, in general, 
defective eigenvalues of A under certain conditions. In a forthcoming paper we provide precise 
error bounds for these approximations based on the results of Theorems 4.1 and 4.5, where we also 
extend the treatment of [SiB] and [Si3] to cover eigenvectors and invariant subspaces. Again, in 
the same paper, we explore the connection of this new approach with Krylov subspace methods. 
Preliminary results on these issues have already appeared in [Si6]. 

The techniques that we use in this work are those that were developed in [Sil], [Si3], [SiB], 
[SiFSm], and the recent work of Sidi [Si4] on classical Pade approximants. In particular, the treat- 
ment of the matrix eigenvalue problem was motivated by the developments of [Si4]. 

The subject of rational approximations to vector- valued functions has received considerable 
attention lately. We shall mention some of the recent literature dealing with functions F(z) that 
are defined by their Maclaurin series (1,1). In [Gr] Graves-Morris developed the generalized inverse 
Sector-valued Pad4 approximants and showed that they are also obtained by applying the vector 
epsilon algorithm to the vector sequence F m (z),m — 0,1,2,... . This work was later extended by 
Graves-Morris and Jenkins in [Gr J 1] and [GrJ2], Determinantal representations for these rational 
approximations are provided in [GrJ2]. In [GrSa] Graves-Morris and SafT analyzed the convergence 
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behavior of these approximations for functions F(z) that are meromorphic in a neighbourhood of 
the origin, and gave some uniform convergence theorems of de Montessus type. For details and 
additional related references we refer the reader to [GrSa]. 

2 Pade-Like Properties 

From (1.2) and (1.3) it is obvious that the numerator P ni k(z) of F Ui k{z) is a vector-valued 
polynomial of degree < n + v + k, while its denominator Q n ,k{ z ) Is a scalar- valued polynomial of 
degree k. 

The special structure of F n> k(z) immediately suggests the following Pade-like property: 


Theorem 2.1 If it exists, F n ^(z) satisfies 

F(z ) - F n>k (z) = 0(z n+l '+ k+1 ) as z-+ 0. 


( 2 . 1 ) 


Proof: From (1.2) we have 

QnMF(z) - P n<k (z ) = £ C >Z k - j \m - Fn+u +j (z)]. (2.2) 

i= o 

The result now follows by realizing that F(z) - F m (z) = 0(z m+1 ) as z 0, m - 0, 1, ... .□ 


The property contained in (2.1) is Pade-like in the sense that, for SMPE and SMMPE with 
v = 0, F ni k(z) is constructed using u 0 , «i, .. M u n+ and F(z) - F n> *(z) = 0(z n + fc +i) as z — ► 0, while 
for STEA with v = k - l,F n ^(z) is constructed using u 0 , u x , .. M « n +2Jk-i» and F(z) - F n> *(z) = 
0(z n + 2k ) as z — > 0. 


Note that the Pade-like property in (2.1) is a result of (1.2) only , and it does not depend on 
how the Cj are determined. As such, it cannot be a factor in determining the true behavior of 
F n ,k( z ) as an approximation to F(z). It is the linear system in (1.4) that determines the behavior 
of F n ^(z) , as we shall see in the next sections. 

Using the linear system in (1.4), we can derive a determinant representation for F n ^{z) that 
resembles the known representation for Pade approximants. 
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Theorem 2.2 F n>k {z ) has the determinant representation 


j-, f \ _ D(z k F n+i/ (z), Z k *-Fn+«/+l (*0) •••» ** , -^n+«/+fcC*0) 
wftere ...,<7*) *5 */ie determinant 




(To 

(T\ 

(Zk 



u 00 

«01 

Uok 

D(c T 0 ,a u . 

II 

b 

«10 

u u 

Ulk 



Uk- 1,0 

UJfc-1,1 ■ ■ ■ 

Uk-\,k 


7n case 04 are vectors, we interpret ( 2 , 4 ) os 


k 

D(o 0 ,(Ti,...,Ok) = 

i=0 


iV t - &ein <7 the cofactor of a in (2-4) ■ 


(2.3) 


(2.4) 


(2.5) 


Proof: Left to the reader. □ 

We note that the determinant representation above serves as a very useful tool in the analysis 
of Fn ik (z). 

Finally, the next result sums up the connection between F Uy k(z) and the various vector extrap- 
olation methods. 


Theorem 2.3 The approximations F Uy k{z) for the three procedures SMPE, SMMPE \ and STEA 
are obtained by applying the generalized versions of MPE } MMPE, and TEA , respectively , as they 
are given in [SiBj to the vector sequence F m (z),m = 0, 1,2,... . 


Proof: By performing elementary row and column transformations on the determinant represen- 
tations given in [SiB, eq. (1.17)], we obtain (2.3). We leave the details to the reader. □ 
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3 Technical Preliminaries and Assumptions 

Assume now that the vector- valued function F(z) is analytic at z = 0 and meromorphic in 
the disk K = {z : \z\ < R). Let Zj = X ~ l ,j = 1,2, be the distinct poles of F(z ) in K, whose 
respective multiplicities are pj + 1 = = 1,2, Let the Zj be ordered such that 

0 < \zi\ < \z 2 \ < ••• < \zt\ < R, (3-1) 


which implies the ordering 


|A 1 |>|A 2 |>...>|A,|> j R- 1 . 


Consequently, F(z) has the representation 

t Pj 


F ( z ) - EE n _ a ? .zV + 1 + G 


(3.2) 


(3.3) 


sad- m* +i 

where aji are constant vectors in C N ,a,j Pj 0,1 < j < t, and G(z) is analytic in K and thus has 
the convergent expansion 

oo 

G{z) = z€K. (3.4) 

3=0 

Lemma 3.1 The coefficients u m of the power series of F(z) in (1.1) are given by 


u m = t 

j= 1 


Pj 


m 


l=o \ < 


Af + a(m,Or, 


(3.5) 


where a.ji are constant vectors in C' v defined as 


Pi 

a.ji = aji 

i=l \ i — l 


(3.6) 


and the vectors a(m,£) = (ai(m,£), •••, a N( m iO) T are suc h that — g m , and thus, for 

each i, 

|a,(m,OI < Mi(0 = max |C?,(«)|, f" 1 € (N, R), but arbitrary. (3.7) 

Here Gi(z) stands for the ith component of G(z). 


Proof: The proof can be achieved by applying Lemma 4.1 of [Si4] to each component of u m . □ 
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F(z) - F m (z) = •£ 
j=l 


m 


Lemma 3.2 The partial sums F m (z) in ( 1.8 ) satisfy 

1 1 

(vr +&(m,e,*x^r, 

where bji(z) are vector-valued rational functions of z defined as 


DilW 

f=o \ l 




i— h+l 


and the vectors b(m,£,z ) = (bj(m, z), bjv(m, z)) T are such that, for each i, 


IM 


IM”».*.*)I < Mi(0 


r, 


M,(£) and £ 6emg as in (3.7). 


(3.8) 


(3.9) 


(3.10) 


Proof: The proof can be achieved by applying Lemma 5.1 of [Si4] to each component of F m (z). □ 


In the sequel we assume that for the approximation procedures SMPE and SMMPE 

X>i + i) = X>i<* 

;=] j=i 


and 


dji, 0 < i < Pj, 1 < j <t, are linearly independent. 

Note that (3.12) is possible as the number of the vectors aji is at most N by (3.11). 


(3.11) 


(3.12) 


As a consequence of (3.12) we obtain the following result: 


Lemma 3.3 If (3.12) is satisfied, then the vectors a jt , 0 < l < PjA < 3 < are linearly indepen- 
dent 


Proof: It is enough to show that for each j the vectors fij/, 0 < l < pj , are linearly independent. If 


we rewrite (3.6) in the form 


Pj 

aji — ^ ^ (xijGjj , 0 < / < pj, 

t=0 


(3.13) 
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where a/,* = 

□ 


i 

i-l 


, then the matrix [a7i]£j =0 is nonsingular. The result now follows from (3.12). 


For the approximation procedure STEA, (3.11) and (3.12) are not needed. 


Although the assumptions in (^.11) and (3.12) pertain to the approximation procedures SMPE 
and SMMPE, they nevertheless involve only the function F(z). We now make additional assump- 
tions that are related more to the approximation procedures as they apply to F(z). We assume 
throughout that 


(?i> a io) 

10) 


(<7i > a ipi) ••• (9i> a <o) (?ii a tpi) 


^0 for SMMPE, 


{<]ki a lpi) (9fc) a to) ••• {Qk, a tp,) 


(3.14) 


and that 

n(g,a iPj )^0 forSTEA. (3.15) 

. j = i 

No additional assumption is needed for SMPE. 


In order for (3.14) to hold it is necessary (but not sufficient) that the two sets of vectors 
{aji : 0 < i < pj, 1 < j < t} and {gi, g*}, each be linearly independent, as has already been as- 
sumed. 

4 Main Results 

Our first result concerns the denominator polynomial Q n ,k( z ) of En,fc( 2 ) an d its zeros for 
n — ► oo, and is an analogue of the generalized Koenig’s theorem for Padd approximants and of 
Theorem 3.1 in [Si4]. The notation is identical to the one introduced in Section 3. 


Theorem 4.1 Assume that the vector-valued function F(z) is as described in the first paragraph of 
Section 3, and that, for the approximation procedures SMPE and SMMPE, F(z) satisfies (3.11) 
and (3.12), in addition. Assume furthermore that (3.14) and (3.15) are satisfied for SMMPE and 
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STEA respectively. Then, provided 


k = 


(4.1) 


j=i 


the polynomial Q n ,k( z ) = Y^j=o Cj k 'z k ~i , c^' k ' = 1, exists for all sufficiently large n, and satisfies 

Q n ,k( z ) = n(l “ Z Y’ +° ( ^ ) asn-> oo, (4.2) 

where R\ € (|z<|,/2), 6ui .Ri is arbitrary otherwise. Consequently, Q n ,k( z ), for n — > oo, /ias zeros 
Zj/(n), 1 < / < L)j, that tend to Zj,j — 1,2, ...,t For each j and l we have 


lim sup 


z A n ) ~ z j 


l/n 


££ 

R 


l/wj 


Let us denote 


Then 


z i( n ) = ^:Jl z d n )- 


> /=i 


(4.3) 

(4.4) 

(4.5) 

(4.6) 

In case the function F(z ) has only polar singularities on the circle dK = {z : \z\ = ii}, */ie results 
in (4-2), (4-3), (4-5), and (4-6) can be strengthened to read precisely 




l/n 

Ti 

lim sup 

n*-+co 

Zj(n) - Zj 

< 

R 


Also the pjth derivative of Q nt k{z) has exactly one zero zj(n) that tends to Zj and satisfies 




l/n 

2: 

lim sup 

n-+oo 

Zj(n) - Zj 

< 

R 


and 


respectively , where 


Qn,k{ z ) = II( 1 “ X 3 Z Y’ + °( f ( n )) aS U °°> 

j=l 

Zji(n ) - Zj = 0(8j{n) x ! Uj ) as n — ♦ oo, 
Zj(n) - Zj = 0(8j(n)) as n —► oo, 


Zj(n ) - Zj = 0(£j(n)) as ra — ► oo, 
e(n) = n° 




R 


(4.7) 

(4.8) 

(4.9) 

(4.10) 

(4.11) 


and Sj(n ) = n p 

ZTere a is some nonnegah've integer, and p + 1 is the maximum of the multiplicities of the poles 
lying on dK. Also, if the poles whose moduli are \z t \ are simple, then a = p. Finally, let us define 
A = l/z,Xji(n) = 1 /zji(n), and set 


h( n ) = ^j-£ A iK«)- 


(4.12) 


) i=i 
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Then A j/(n) ? 1 < / < u>j, are the zeros of the polynomial in A Qn,*(A) = z~ k Q n ,k( z ) that tend to 
Similarly, the pjth derivative of Q nt k( A) has a unique zero A j(n) that tends to Aj = 1/zj as 
n — ► oo. The results in (4*3), (4*3), and (4*3), and in (4*3) - (4*10) hold also when the z’s on the 
left hand sides are replaced by the corresponding A ’s. 


Proof: We do not intend to give the proofs of all of the results stated above. We shall be content 
with a short sketch of the proof of (4.2), and refer the reader to the appropriate references for the 
rest. 


We start by observing that it is sufficient to analyze the determinant 
Z?(A°, A 1 ,..., A*) = z~ k D(z k , z k ~ l , which is proportional to Q n ,k{ A), which, in turn, is pro- 

portional to Q ni k{z)> Employing Lemma 3.1, we obtain the asymptotic behavior of the u tJ in (1.5) 
for SMPE, SMMPE, and STEA. Substituting this in the determinant representation of (2.4) and 
following [SiB, Section 5.3], we obtain, for SMPE, 

t 


IK’ 

j'=i 


D( A 0 , A 1 ,..., A*) = W 
£ being as in (3.7). Here 

W = (-1 fz 


2 n r 


ri( A - *>)"’ + ° ( | £| ) n 


as n — > oo, 


(4.13) 


n ^ +i)/2 n - ( 4 - 14 ) 

j~\ i<t<j<t 

where Z is the Gram determinant of the k vectors aji, 0 < / < pj, 1 < j < t. By the assumption 
(3.12), Lemma 3.3 holds, so that these vectors are linearly independent. Consequently, Z > 0, 
hence W ^ 0 for SMPE. For SMMPE and STEA, following [SiB, Sections 5.1 and 5.2] , we obtain 

t \ 


3 - 1 


Here 


nw(lif) 
w = ( S A?<w+I,/! ) ( ,<S<< (Ai ‘ ) ’ 


as 7i — ► oo. 


(4.15) 


(4.16) 


where Z is the k x k determinant 



210,1 • 

. . Zlp lt l 

• • 2*0,1 

* * * z tp u 1 

z = 

^10, 2 • 

■ * z lp\ ,2 

* ■ 2*0,2 

♦ * • 2* pti 2 


Z\0,k • 

'* Z lpuk * 

• • 2*o, k 

• . • z tptM 


(4.17) 
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with 


z jl,h — (QhiQjl) 


(4.18) 


for SMMPE, and 


pj 


z jih — Qji) 

t=i 


h - 1 

t-/ 




(4.19) 


for STEA. Performing elementary column transformations on (4.17), it can be shown that Z for 
SMMPE is equal to the determinant in (3.14), while Z for STEA is equal to 


(_!)£-. w<w+»/» ( «„,)“< ) ( n;=. ) ( n 1 < i < j <«(>, - *.•) 

By what has been assumed, we see that Z / 0, hence W / 0 for SMMPE and STEA 


U»iU>j 


By VP ^ 0, the proof of (4.2) is now complete for SMPE, SMMPE, and STEA. The rest of the 
theorem can be proved by employing the techniques that were used in the proof of Theorem 3.1 of 
[Si4] . □ 


The results of Theorem 4.1 are optimal, in general. For one important special case, however, the 
results pertaining to the SMPE approximations can be improved considerably. In this special case 
the function F(z) is rational with simple poles and its residues form an orthogonal set of vectors 
with respect to the inner product (■ , •). We postpone the presentation of these results to Theorem 
4.5 at the end of this section. 


Our next result concerns the convergence of F n ^{z) for n — ► oo, and is an analogue of de Montes- 
sus’s theorem for Pade approximants and of Theorem 3.3 in [Si4]. Below and in the remainder of 
this work we are going to use |/| to also mean the norm of / in case / € C N . 


Theorem 4*2 Let F(z ) and F nt k(z) be exactly as in Theorem 4-L Then f as n —► oo, F n} k(z) con- 
verges to F(z) uniformly in any compact subset of K\{z\, In fact } 


Fn,k{*) - CM = 0 ( 1 17 1" ) 


as n 


oo, 


(4.20) 


uniformly in any compact subset of A’\{zi, R\ being, as in Theorem 4-1, in {\z t \,R), but 

arbitrary otherwise. In case F(z ) has only polar singularities on dK = {z : \z\ — R}, this result 
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can be improved to read precisely 


F n , k (z) - F(z) = 0 



as n 


oo, 


(4.21) 


uniformly in any compact subset of Ii\{zi, where p + 1 is the maximum of the multiplicities 

of the poles of F(z) that lie on dK . 


Proof: We start by noting that 


F n , k (z) - F(z) 


where crj 


£(( 70 ,( 71 ,... ,< 7 *) _ E n<k (z ) 

D(z k ,z k ~\...,z°) ~ D(z k ,...,z°Y 
z k ^[F n+l/+j (z)-F(z)], 0 <j<k. 


(4.22) 


Next, by employing (3.5) and (3.8) in the determinant representation of E Ui k(z), and following [SiB, 
Section 5.3], we obtain, for SMPE, 


E n ,k( z ) = 0 


n*? 

;=1 


2 n 


£ n Z n 


as n — > co, 


(4.23) 


£ being as in (3.7). The result in (4.20) for SMPE now follows by combining (4.23) and (4.13) in 
(4.22). For SMMPE and STEA, following [SiB, Sections 5.1 and 5.2], we obtain 

t 


E n ,k{z ) = 0 


rE? 

j= 1 


£n z n 


as n oo. 


(4.24) 


The result in (4.20) for SMMPE and STEA now follows by combining (4.24) and (4,15) in (4.22). 
Both (4.23) and (4.24) hold uniformly in any compact subset of K\{zi, z t } since the functions 
bji(z) and b(m,£ y z) are all uniformly bounded away from the poles zi,...,z*. Consequently, (4.20) 
holds uniformly in any compact subset of K \{zi, The proof of (4.21) can be achieved simi- 

larly. □ 


Our next result shows how F n ^{z) can be used to construct the principal part of the Laurent 
expansion of F(z) about any of the poles z 1} ,,.,z t with optimal accuracy. 

Let us rewrite (3.3) in the form 

FW= gSf^ +GW ' ■ (4 - 25) 

where 

• ■■ 1 dji = (-Zj) t+1 aji for all j, i. (4.26) 
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Theorem 4.3 Let F(z) and F nj fc(z) be exactly as in Theorem 4 A. Denote 

<j(n) = ij(n) or (j(n) = 1/A j(n) or <j(n) = Zj(n) or Cj(n) = 1/A,(n), (4.27) 

and denote the residue of the rational function ( z - Cj(n))‘.F ni *( 2 ) z jl( n ) by djij(n), 1 < / < Wj, 
0 < t < pj . Then 

Wj 1/n 

lim sup Y^djijln) - dji < ^ . (4.28) 

n— +oo Jti 

Proof: Let Kj = {z : \z - Zj\ < e] with e > 0 chosen sufficiently small to ensure that I(j contains 
only Zj and no other poles of F(z). By Theorem 4.1, for n sufficiently large, Kj contains only 
Zji(n), 1 < l < Wj, and no other poles of F n< k(z). Let dKj denote the boundary of Kj. By the fact 
that (4.20) holds uniformly in any compact subset of we have 

Fn,k(z) ~ F(z) = o ( [ ] ) as n — *■ oo, (4.29) 

R\ being as in Theorems 4.1 and 4.2. We now note that 

dji = 97- / ( 2 “ z }YF{z)dz (4.30) 

^7T1 J j 

and, for n sufficiently large, 

(4-31) 

2/K\ Jdhj 

Consequently, 

f>;,y(n) - dji = / A n ,*(*) <fc, (4-32) 

2 JdKj 

where 

A n ,*(*) = (* - 0(n))’F n , fc ( 2 ) - (z - *,•)*>(*) cfz. (4.33) 


iA n ,*(*)i < | 2 - o(»)i i iJ , n,fc(*) - ^(*)i + \{* - Ci(»))‘' - (* - ^y'li wi. ( 4 - 34 ) 

The first term on the right hand side of (4.34) is 0 ^ ^ j ^ as n —► oo, by (4.29). Also, 

(z-QWy-iz-ZjY = (Zj-Cj(n))'t(z-Cj(n)r(z-Zjy-^ 



asn-+oo,(i >0 arbitrary, (4.35) 


15 


by Theorem 4.1, c.f. (4.5) and (4.6). Combining (4.29) and (4.35) in (4.34), we obtain 

l/n 


limsup max 

n— kx> \ ztdKj 


&n,k( Z ) 


) £ 


R 


(4.36) 


Taking the modulus of both sides of (4.32), and employing (4.36), (4.28) now follows. □ 


It is interesting to note that the technique used in the proof of Theorem 4.3 can be used to 
prove other useful results concerning F(z). One such result is given in Theorem 4.4 below. 


Theorem 4.4 Let F(z ) and F n ^(z) be as in Theorem and let H(z) be analytic in a neigh- 
bourhood of Zj . Then 


lim sup 

n— *oo 


(jjj 

-7 X>(^(n)) - H { Zj ) 

Vi , , 


J 1=1 



(4.37) 


Proof: Let the disk Kj in the proof of Theorem 4.3 be so small that it does not include any of the 
zeros of F(z). Then there is a constant vector w G C N for which (w, F(z)) ^ 0 on dKj, Thus 


and 


P; 


(w,F(z)) 

(4.38) 

<*(*)) ^ 
\ W ,F n , k (z)) Z • 

(4.39) 


The rest of the proof can now be completed as that of Theorem 4.3. □ 


It is easy to see that, letting H(z) = z in (4.37), we obtain the result in (4.5) that pertains to 
£j(n). Similarly, letting H(z) = z - * 1 in (4.37), we obtain the analogous result pertaining to A ; (n). 
The stronger result for Zj{n) given in (4.9), and the corresponding result for A ; (n), cannot be ob- 
tained from Theorem 4.4, however. 

We now give the improved version of Theorem 4.1 for the special case mentioned following the 
proof of Theorem 4,1. 
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Theorem 4.5 Let the vector-valued function F(z ) in Theorem f.l be rational with simple poles, 

i.e., 

F( z ) ~ XI 7 7"T + ^( z )> (4.40) 

j = 1 l ~ A J z 

where a, are constant vectors in C N and G(z ) is a vector- valued polynomial. Assume furthermore 
that (i < N and that 

{aj,a h ) = 0 ifj^h. (4.41) 

Then, provided 

\zk\ < |-z*+i| or equivalently |Ajt| > |A fc+1 |, (4.42) 

the polynomial Q n ,k(z) associated with the SMPE approximation procedure exists for all n suffi- 
ciently large, and satisfies 

^ / i i2n 


_ / y 2n \ 

Qn,k{z) = IJ(1 " + 0 { ) aS U 

j=l V Zk+1 / 


oo. 


(4.43) 


Consequently, Qn t k( z )f f or n °°) ^ as exactly one zero Zj(n) that tends to zj,j = 1,2 For 
each j y 1 < j < k, we have 

z j(n) - zj = 0 ( Zj I aa n oo, (4.44) 

V Zk + 1 | / 

and t/ns holds true also when Zj{n ) and Zj on the left hand side are replaced by A ; (n) = l/zj(n) 
and Aj = l/zj. 


Proof: We start by observing that, from (4.40) and the fact that G(z) is a polynomial, we have 

Um — for all sufficiently large m. (4.45) 

i==i 

The result now follows from Theorem 2.1 in [Si3], where the most dominant term of the asymptotic 
expansion of A ; (n) - A j for n oo is given explicitly. □ 

It is important to note that the condition given in (4.1) for Theorems 4.1 and 4.2 seems to be 
crucial as far as the convergence of Q n ,k{ z ) and F n ^{z) is concerned. According to this condition, k 
is the precise number of poles counted according to their multiplicities contained in K . When this 
condition is not satisfied, i.e., when k is larger than this number, we cannot expect convergence to 
take place, in general. When the only singularities on dK are poles, however, it might be possible 
to obtain some convergence results under certain conditions when k is greater than the number of 
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poles in K but smaller than the number of poles in K U dK . Interesting results for this problem 
pertaining to classical Pade approximants have been given in [Si4, Section 6]. Analogous results 
that form an extension of Theorem 4.5 have been provided in [Si3, Section 3]. We do not intend to 
go into this matter in the present work, however. 


5 Further Results on Residues 


From the way the denominator polynomial Q n ,k( z ) °f F ni k(z) Is constructed, it is clear that 
the approximations Zj(n) and zj(n) to Zj , j =1,2, are obtained from the vectors u n ,u n+ j , u n +k 
in the case of the SMPE and SMMPE procedures, and from u n , u n +i, u n + 2 k-i In the case of 
the STEA procedure. This means that the vectors Uo,Ui, need not be saved if we are only 

interested in approximating the smallest poles of F(z). This is important since we are considering 
the limiting process in which n — ► oo. 

From (4.25) and (4.26) and Theorem 4.3, the approximation to the vector aj t is given as 
aji(n) = (—A j)* +1 djt We now show that the computation of the vectors aji(n) can be 

made to enjoy the same property in the sense that knowledge of is not essential in 

this case either. 

Let us write the vectors djij(n) introduced in Theorem 4.3 explicitly. By the fact that Zji(n) is 
a simple pole of F ni k{z) for n sufficiently large, we have 


, M - f. /* r ^LoC { r n ' k) Z k - r Fn + v + r(z) t 
d ji,l( n ) ~ (Z <A n )) c (n,fc)^ _ r ^ z k-r - 1 lz= ^'( n )’ 

Writing -F’n+j'+r^) = F n +v(z) -f Em1=n+i'+i ti m 2 m in (5.1), and using the fact that 
E?=o c r n ’ fc) ** -r !*=*,,(«) = 0, we obtain 

E k h-r X^n+v+r y m 

t = 0 Cr z 2^m=n-hi/+ 1 I 

a JiA n ) ~ 1* ^A n )) c (n r )Ifc- r — i ,z=z " (n) ’ 


(5.1) 


(5.2) 


in which the absence of the vectors Uo, u n _i ls transparent. 

Developing the approach that leads to (5.2) further, in the remainder of this section we give 
approximants to the aji that are different from the ajj(n) above. These new approximations will 
be used in the treatment of the matrix eigenvalue problem in the next section. 

Consider the meromorphic function 

F{z ) - F n+l/ (z ) 


F(z) = 


z n-f ^+1 


(5.3) 
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which is analytic at z — 0 and has the Maclaurin series expansion 


F( Z ) ~ u n+i/+i+l ^ • 

»=0 


By (4.25) we can write 


where 


Pj 


p{2) = § (z 

w i 




f=t 


— 71 — 1/ — 1 

I-i 


z~ l+i dji, 


and Gj(z) is analytic at Zj. Consequently, 

d » = w, 

with the disk Kj as in the proof of Theorem 4,3. 


Consider next the rational function 


Kk{z) 


fnMz) ~ Frij^iz) 


Denote the residue of ( z - (j(n)) t f'n,k{z) at Zji(n) by 1 < / < Wj, and let 


/=i 


Then 


(5.4) 


(5.5) 


(5.6) 


(5.7) 


(5.8) 


(5.9) 


(5.10) 


for n sufficiently large. 

Subtracting (5.7) from (5.10), invoking (5.3) and (5.8), and observing that the contribution of 
the polynomial F n +v(z) is zero, we obtain 


j / „ \ j _ 1 / ^n,fc(^) j 

d Jt (n) - dji - j 9K ' zn+u+l dz y 


with A n , k (z) as defined in (4.33). Following now the proof of Theorem 4.3, we obtain 


„ „ 1/n - 

limsup dji(n) - dji < R . 


(5.11) 


(5.12) 


It is important to note that 


dji,i( n ) = dji t /(n)/zji(n) 


n+i/ -fl 


V'k (n t k) u-r ,m-l 

— (y C(W\Y — I^LlT Z Z^m = l u n+v+m* | 


(5.13) 
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so that the factor Zji(n) n has disappeared from djij(n). Consequently, dji(n) does not involve the 
factors Zji(n) n y 1 < l < u>j. In view of the fact the we are interested in the limit as n — ► oc, the 
absence of the Zji(n) n is expected to have a stabilizing effect in actual numerical computations. In 
fact, the developments of this section were prompted also by the desire to eliminate the factors 
Zjl{n) n from the approximations to the aj { . We shall make use of these new approximations to the 
aji in our treatment of the matrix eigenvalue problem in the future. 


6 Extension to General Linear Spaces 


In the previous sections we considered F(z) to be a function from C to C N . We would now 
like to explore the possibility that F(z) is a function from C to a general linear space B. We note 
that in [Sil], [Si3], [SiB], and [SiFSm] vector extrapolation methods were defined and analyzed for 
sequences in such spaces under certain assumptions. 

There seems to be no problem in defining the rational approximation procedures SMPE, SMMPE, 
and STEA in general spaces. We only need to demand that B be 

(i) an inner product space for SMPE, 

(ii) a normed space for SMMPE and STEA. 

Then if F(z) is as given in (1.1) with u m 6 B,m = 0, 1,..., the rational approximations F nt k{z) to 
F(z) are exactly as in (1.2) and (1.3). The scalars c( n ’^ again satisfy the linear equations in (1.4) 
with U{j defined by 


Uij = < 


(^n+ii^n+j) Ibr SMPE, 

Qt>iK+j) for SMMPE, (6.1) 

[ Q(u n+i+J ; ) for STEA. 

Here too (■ , •) is the inner product associated with the inner product space J3, whose homogeneity 
property is such that ( ax,(3y ) = a/?(x, y) for x,y € B and a,/? £ C. Q i, Qk, &nd Q a-re bounded 
linear functionals on the normed space B , and Qi^.^Qk are, of course, assumed to be linearly 
independent. In case B is a complete inner product space in addition to being a normed space, 
the functionals Qu-.^Qk and Q have unique representers and q , respectively, in B, so 


that for SMMPE and STEA become 


= 




(?t'+l ) u n+j) 

(?i u n+i+i ) 


for SMMPE, 
for STEA, 


( 6 . 2 ) 


c.f. (1.5). 
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With F nt k(z) properly defined, we now go on to discuss the extension of Theorems 4. 1-4.4. Going 
through the proofs of these theorems, we see that they hold when F{z) satisfies the conditions 
stated in Section 3 provided (3.7) and (3.10) are interpreted in a suitable manner. Thus, (3.7) is 
interpreted as 

|d(™,OI ^ ^(0 = max |<2(z)|, £ -1 € (|2 t |,-R), but arbitrary, (6.3) 

while (3.10) is interpreted as 

[fr(m,f,*)l < \z\<r\ (6.4) 

with M(£) as in (6.3). As before, |/| stands for the norm of / when / € B. In case B is an 
inner product space, this norm can be taken to be the one induced by the inner product. Also, in 
case B is only a normed linear space, in the proof of Theorem 4.4 the assertion (a?, F(z)) ^ 0 on 
dKj is replaced by T(F(z)) ^ 0 on dKj , where T is some bounded linear functional on B . 

The result given in Theorem 4.5 can be maintained both when F(z) is a rational function and 
when F(z) has an infinite number of poles so that the u m satisfy asymptotically 

oo 

U m ~ 35 171 00 • ( 6 - 5 ) 

j=l 

Precisely this is the subject of [Si3]. 

Finally, we mention that one immediate application of the rational approximation procedures 
is to the solution of the operator equation 

x = zAx + b (6.6) 

where A is a bounded linear operator on B. In this case the solution x = (/ — zA)~ l b to (7.6) 
has the convergent Maclaurin expansion 

oo 

x = u m z m with u m = A m b, m = 0, 1, ... . (6.7) 

m=0 

Under appropriate conditions on the spectrum of A all of the results of Sections 4 and 5 hold. We 
leave out the details. 
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